Pandas Profiling Report

Dataset statistics

Number of variables	15
Number of observations	5698
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	667.9 KiB
Average record size in memory	120.0 B

Variable types

Numeric	15

Alerts

`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`recency_days` is highly correlated with `qnt_purchases`	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`freq_purchase` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qtd_returned` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_variety` is highly correlated with `var_products` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`var_products` is highly correlated with `avg_basket_variety`	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_basket_size` is highly correlated with `avg_basket_variety`	High correlation
`avg_basket_variety` is highly correlated with `var_products` and 1 other fields	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 3 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`freq_purchase` is highly correlated with `qnt_purchases`	High correlation
`qtd_returned` is highly correlated with `freq_returns` and 2 other fields	High correlation
`freq_returns` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 1 other fields	High correlation
`avg_basket_variety` is highly correlated with `var_products`	High correlation
`item_rp_ratio` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`net_margin` is highly correlated with `qtd_returned` and 2 other fields	High correlation
`df_index` is highly correlated with `customer_id` and 1 other fields	High correlation
`customer_id` is highly correlated with `df_index` and 2 other fields	High correlation
`gross_revenue` is highly correlated with `qnt_purchases` and 4 other fields	High correlation
`recency_days` is highly correlated with `df_index` and 1 other fields	High correlation
`qnt_purchases` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`var_products` is highly correlated with `gross_revenue` and 5 other fields	High correlation
`qnt_items` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`qtd_returned` is highly correlated with `gross_revenue` and 3 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_basket_variety` is highly correlated with `customer_id` and 2 other fields	High correlation
`item_rp_ratio` is highly correlated with `net_margin`	High correlation
`net_margin` is highly correlated with `item_rp_ratio`	High correlation
`gross_revenue` is highly skewed (γ1 = 23.64230131)	Skewed
`qnt_items` is highly skewed (γ1 = 25.34473112)	Skewed
`avg_ticket` is highly skewed (γ1 = 48.12570503)	Skewed
`qtd_returned` is highly skewed (γ1 = 24.95562219)	Skewed
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`qtd_returned` has 4198 (73.7%) zeros	Zeros
`freq_returns` has 4198 (73.7%) zeros	Zeros
`item_rp_ratio` has 4198 (73.7%) zeros	Zeros

Reproduction

Analysis started	2021-10-23 01:50:45.776909
Analysis finished	2021-10-23 01:51:08.069973
Duration	22.29 seconds
Software version	pandas-profiling v3.1.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

HIGH CORRELATION
UNIFORM
UNIQUE

Distinct	5698
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2897.338189

Minimum	0
Maximum	5788
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	289.85
Q1	1455.25
median	2899.5
Q3	4342.75
95-th percentile	5497.15
Maximum	5788
Range	5788
Interquartile range (IQR)	2887.5

Descriptive statistics

Standard deviation	1669.76685
Coefficient of variation (CV)	0.5763106485
Kurtosis	-1.196205631
Mean	2897.338189
Median Absolute Deviation (MAD)	1444
Skewness	-0.003581351907
Sum	16509033
Variance	2788121.335
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
3847	1	< 0.1%
3867	1	< 0.1%
3866	1	< 0.1%
3865	1	< 0.1%
3864	1	< 0.1%
3863	1	< 0.1%
3862	1	< 0.1%
3861	1	< 0.1%
3860	1	< 0.1%
Other values (5688)	5688	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5788	1	< 0.1%
5787	1	< 0.1%
5786	1	< 0.1%
5785	1	< 0.1%
5784	1	< 0.1%
5783	1	< 0.1%
5782	1	< 0.1%
5781	1	< 0.1%
5780	1	< 0.1%
5779	1	< 0.1%

customer_id
Real number (ℝ_≥0)

HIGH CORRELATION
UNIQUE

Distinct	5698
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16600.64812

Minimum	12347
Maximum	22709
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	12347
5-th percentile	12699.55
Q1	14287.25
median	16226.5
Q3	18211.75
95-th percentile	21725.15
Maximum	22709
Range	10362
Interquartile range (IQR)	3924.5

Descriptive statistics

Standard deviation	2809.23708
Coefficient of variation (CV)	0.1692245423
Kurtosis	-0.8230600484
Mean	16600.64812
Median Absolute Deviation (MAD)	1964
Skewness	0.4410586186
Sum	94590493
Variance	7891812.973
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
17997	1	< 0.1%
17891	1	< 0.1%
16498	1	< 0.1%
13745	1	< 0.1%
15584	1	< 0.1%
21089	1	< 0.1%
21088	1	< 0.1%
21087	1	< 0.1%
21086	1	< 0.1%
Other values (5688)	5688	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12349	1	< 0.1%
12350	1	< 0.1%
12352	1	< 0.1%
12353	1	< 0.1%
12354	1	< 0.1%
12355	1	< 0.1%
12356	1	< 0.1%
12357	1	< 0.1%

Value	Count	Frequency (%)
22709	1	< 0.1%
22708	1	< 0.1%
22707	1	< 0.1%
22706	1	< 0.1%
22705	1	< 0.1%
22704	1	< 0.1%
22700	1	< 0.1%
22699	1	< 0.1%
22696	1	< 0.1%
22695	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	5454
Distinct (%)	95.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1735.645921

Minimum	0.42
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0.42
5-th percentile	13.2355
Q1	236.4925
median	612.07
Q3	1567.645
95-th percentile	5228.677
Maximum	279138.02
Range	279137.6
Interquartile range (IQR)	1331.1525

Descriptive statistics

Standard deviation	7432.526681
Coefficient of variation (CV)	4.282282803
Kurtosis	729.0754875
Mean	1735.645921
Median Absolute Deviation (MAD)	477.79
Skewness	23.64230131
Sum	9889710.46
Variance	55242452.87
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
7.95	9	0.2%
2.95	8	0.1%
1.25	8	0.1%
4.95	8	0.1%
12.75	7	0.1%
1.65	7	0.1%
3.75	7	0.1%
4.25	6	0.1%
7.5	6	0.1%
5.95	6	0.1%
Other values (5444)	5626	98.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.84	4	0.1%
0.85	3	0.1%
1.07	1	< 0.1%
1.25	8	0.1%
1.44	1	< 0.1%
1.65	7	0.1%
1.69	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
70100.49	1	< 0.1%
66653.56	1	< 0.1%
65039.62	1	< 0.1%

recency_days
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	304
Distinct (%)	5.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	116.8555634

Minimum	0
Maximum	373
Zeros	37
Zeros (%)	0.6%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	3
Q1	23
median	71
Q3	199
95-th percentile	338
Maximum	373
Range	373
Interquartile range (IQR)	176

Descriptive statistics

Standard deviation	111.5314761
Coefficient of variation (CV)	0.9544387354
Kurtosis	-0.6378758846
Mean	116.8555634
Median Absolute Deviation (MAD)	61
Skewness	0.8154086444
Sum	665843
Variance	12439.27016
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	110	1.9%
4	105	1.8%
3	98	1.7%
2	92	1.6%
10	86	1.5%
8	82	1.4%
17	79	1.4%
9	79	1.4%
7	78	1.4%
15	67	1.2%
Other values (294)	4822	84.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	37	0.6%
1	110	1.9%
2	92	1.6%
3	98	1.7%
4	105	1.8%
5	52	0.9%
7	78	1.4%
8	82	1.4%
9	79	1.4%
10	86	1.5%

Value	Count	Frequency (%)
373	23	0.4%
372	22	0.4%
371	17	0.3%
369	4	0.1%
368	13	0.2%
367	16	0.3%
366	15	0.3%
365	19	0.3%
364	11	0.2%
362	7	0.1%

qnt_purchases
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	56
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	3.47034047

Minimum	1
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	1
Q3	4
95-th percentile	11
Maximum	206
Range	205
Interquartile range (IQR)	3

Descriptive statistics

Standard deviation	6.808567324
Coefficient of variation (CV)	1.961930647
Kurtosis	302.6603825
Mean	3.47034047
Median Absolute Deviation (MAD)	0
Skewness	13.20268773
Sum	19774
Variance	46.356589
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2870	50.4%
2	829	14.5%
3	503	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%
Other values (46)	332	5.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	2870	50.4%
2	829	14.5%
3	503	8.8%
4	394	6.9%
5	237	4.2%
6	173	3.0%
7	138	2.4%
8	98	1.7%
9	69	1.2%
10	55	1.0%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	< 0.1%
86	1	< 0.1%
72	1	< 0.1%
62	1	< 0.1%
60	2	< 0.1%
57	1	< 0.1%

var_products
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	438
Distinct (%)	7.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	69.47929098

Minimum	1
Maximum	1786
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	13
median	36
Q3	84
95-th percentile	241
Maximum	1786
Range	1785
Interquartile range (IQR)	71

Descriptive statistics

Standard deviation	100.7637571
Coefficient of variation (CV)	1.450270371
Kurtosis	43.72624843
Mean	69.47929098
Median Absolute Deviation (MAD)	28
Skewness	4.650616344
Sum	395893
Variance	10153.33475
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	277	4.9%
2	149	2.6%
3	112	2.0%
10	101	1.8%
5	97	1.7%
9	96	1.7%
11	93	1.6%
6	93	1.6%
8	93	1.6%
7	90	1.6%
Other values (428)	4497	78.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	277	4.9%
2	149	2.6%
3	112	2.0%
4	90	1.6%
5	97	1.7%
6	93	1.6%
7	90	1.6%
8	93	1.6%
9	96	1.7%
10	101	1.8%

Value	Count	Frequency (%)
1786	1	< 0.1%
1766	1	< 0.1%
1322	1	< 0.1%
1118	1	< 0.1%
884	1	< 0.1%
817	1	< 0.1%
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%
717	1	< 0.1%

qnt_items
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED

Distinct	1835
Distinct (%)	32.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	943.7620218

Minimum	1
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	106
median	317
Q3	801.75
95-th percentile	2894.75
Maximum	196844
Range	196843
Interquartile range (IQR)	695.75

Descriptive statistics

Standard deviation	4173.345102
Coefficient of variation (CV)	4.422031196
Kurtosis	956.6808892
Mean	943.7620218
Median Absolute Deviation (MAD)	253
Skewness	25.34473112
Sum	5377556
Variance	17416809.34
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	113	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	25	0.4%
88	22	0.4%
72	21	0.4%
7	20	0.4%
Other values (1825)	5260	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	113	2.0%
2	73	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
7	20	0.4%
8	18	0.3%
9	7	0.1%
10	17	0.3%

Value	Count	Frequency (%)
196844	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%
50255	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

SKEWED

Distinct	5505
Distinct (%)	96.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	31.03434847

Minimum	0.42
Maximum	13305.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0.42
5-th percentile	3.460567302
Q1	7.95
median	15.85435606
Q3	21.96158411
95-th percentile	75.16291917
Maximum	13305.5
Range	13305.08
Interquartile range (IQR)	14.01158411

Descriptive statistics

Standard deviation	210.7747768
Coefficient of variation (CV)	6.791661083
Kurtosis	2837.677304
Mean	31.03434847
Median Absolute Deviation (MAD)	7.490555851
Skewness	48.12570503
Sum	176833.7176
Variance	44426.00652
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
3.75	11	0.2%
4.95	10	0.2%
2.95	9	0.2%
1.25	9	0.2%
7.95	8	0.1%
12.75	7	0.1%
8.25	7	0.1%
1.65	7	0.1%
4.15	6	0.1%
3.35	6	0.1%
Other values (5495)	5618	98.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.42	3	0.1%
0.535	1	< 0.1%
0.65	1	< 0.1%
0.79	1	< 0.1%
0.8371428571	1	< 0.1%
0.84	2	< 0.1%
0.85	3	0.1%
1.002222222	1	< 0.1%
1.02	1	< 0.1%
1.03875	1	< 0.1%

Value	Count	Frequency (%)
13305.5	1	< 0.1%
4599.68	1	< 0.1%
3861	1	< 0.1%
3202.92	1	< 0.1%
3096	1	< 0.1%
1687.2	1	< 0.1%
1377.077778	1	< 0.1%
1001.2	1	< 0.1%
952.9875	1	< 0.1%
931.5	1	< 0.1%

freq_purchase
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION

Distinct	1226
Distinct (%)	21.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.5475501672

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.01104667696
Q1	0.02494806094
median	1
Q3	1
95-th percentile	1
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.9750519391

Descriptive statistics

Standard deviation	0.5508335323
Coefficient of variation (CV)	1.005996464
Kurtosis	138.4768319
Mean	0.5475501672
Median Absolute Deviation (MAD)	0
Skewness	4.845559381
Sum	3119.940853
Variance	0.3034175803
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2878	50.5%
2	49	0.9%
0.0625	18	0.3%
0.02777777778	17	0.3%
0.02380952381	16	0.3%
0.08333333333	15	0.3%
0.03448275862	15	0.3%
0.09090909091	15	0.3%
0.02941176471	14	0.2%
0.02127659574	13	0.2%
Other values (1216)	2648	46.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	< 0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	< 0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	< 0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
4	1	< 0.1%
3	5	0.1%
2	49	0.9%
1.142857143	1	< 0.1%
1	2878	50.5%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%

qtd_returned
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
SKEWED
ZEROS

Distinct	210
Distinct (%)	3.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	16.14987715

Minimum	0
Maximum	6504
Zeros	4198
Zeros (%)	73.7%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	1
95-th percentile	38
Maximum	6504
Range	6504
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	154.3255531
Coefficient of variation (CV)	9.555834491
Kurtosis	807.125368
Mean	16.14987715
Median Absolute Deviation (MAD)	0
Skewness	24.95562219
Sum	92022
Variance	23816.37634
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4198	73.7%
1	169	3.0%
2	151	2.7%
3	105	1.8%
4	89	1.6%
6	78	1.4%
5	61	1.1%
12	52	0.9%
7	44	0.8%
8	43	0.8%
Other values (200)	708	12.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4198	73.7%
1	169	3.0%
2	151	2.7%
3	105	1.8%
4	89	1.6%
5	61	1.1%
6	78	1.4%
7	44	0.8%
8	43	0.8%
9	41	0.7%

Value	Count	Frequency (%)
6504	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%
1594	1	< 0.1%
1535	2	< 0.1%

freq_returns
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	427
Distinct (%)	7.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.1616901892

Minimum	0
Maximum	4
Zeros	4198
Zeros (%)	73.7%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.009901311518
95-th percentile	1
Maximum	4
Range	4
Interquartile range (IQR)	0.009901311518

Descriptive statistics

Standard deviation	0.3730391124
Coefficient of variation (CV)	2.30712274
Kurtosis	4.862729409
Mean	0.1616901892
Median Absolute Deviation (MAD)	0
Skewness	2.20137007
Sum	921.310698
Variance	0.1391581793
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4198	73.7%
1	853	15.0%
2	14	0.2%
0.5	8	0.1%
0.2857142857	8	0.1%
0.02564102564	7	0.1%
0.25	6	0.1%
0.009478672986	5	0.1%
0.01960784314	5	0.1%
0.01298701299	5	0.1%
Other values (417)	589	10.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4198	73.7%
0.005571030641	1	< 0.1%
0.005681818182	2	< 0.1%
0.005865102639	1	< 0.1%
0.005934718101	1	< 0.1%
0.005952380952	1	< 0.1%
0.006024096386	1	< 0.1%
0.006042296073	1	< 0.1%
0.006172839506	1	< 0.1%
0.006191950464	1	< 0.1%

Value	Count	Frequency (%)
4	1	< 0.1%
3	1	< 0.1%
2	14	0.2%
1	853	15.0%
0.75	1	< 0.1%
0.6666666667	4	0.1%
0.5	8	0.1%
0.4285714286	1	< 0.1%
0.4	4	0.1%
0.3333333333	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	2365
Distinct (%)	41.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	242.2348805

Minimum	1
Maximum	7824
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	75
median	152
Q3	290
95-th percentile	731.15
Maximum	7824
Range	7823
Interquartile range (IQR)	215

Descriptive statistics

Standard deviation	345.1539697
Coefficient of variation (CV)	1.424873119
Kurtosis	83.50967642
Mean	242.2348805
Median Absolute Deviation (MAD)	96.5
Skewness	6.639402785
Sum	1380254.349
Variance	119131.2628
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	114	2.0%
2	72	1.3%
3	51	0.9%
4	49	0.9%
5	35	0.6%
6	29	0.5%
12	26	0.5%
72	22	0.4%
100	22	0.4%
73	21	0.4%
Other values (2355)	5257	92.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	114	2.0%
2	72	1.3%
3	51	0.9%
3.333333333	1	< 0.1%
4	49	0.9%
5	35	0.6%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6	29	0.5%
6.142857143	1	< 0.1%

Value	Count	Frequency (%)
7824	1	< 0.1%
5963	1	< 0.1%
4507	1	< 0.1%
4300	1	< 0.1%
4282	1	< 0.1%
4280	1	< 0.1%
4136	1	< 0.1%
3906	1	< 0.1%
3868.65	1	< 0.1%
3028	1	< 0.1%

avg_basket_variety
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1169
Distinct (%)	20.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	37.05971538

Minimum	0.2
Maximum	748
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0.2
5-th percentile	1
Q1	7.285714286
median	15.07417582
Q3	31
95-th percentile	173
Maximum	748
Range	747.8
Interquartile range (IQR)	23.71428571

Descriptive statistics

Standard deviation	75.5306435
Coefficient of variation (CV)	2.038079427
Kurtosis	28.43551958
Mean	37.05971538
Median Absolute Deviation (MAD)	9.925824176
Skewness	4.854137488
Sum	211166.2582
Variance	5704.878107
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	276	4.8%
2	161	2.8%
3	115	2.0%
9	105	1.8%
10	105	1.8%
8	103	1.8%
7	101	1.8%
6	101	1.8%
5	100	1.8%
13	97	1.7%
Other values (1159)	4434	77.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.2	1	< 0.1%
0.25	3	0.1%
0.3333333333	7	0.1%
0.4	1	< 0.1%
0.4090909091	1	< 0.1%
0.5	12	0.2%
0.5454545455	1	< 0.1%
0.5555555556	1	< 0.1%
0.5714285714	1	< 0.1%
0.6176470588	1	< 0.1%

Value	Count	Frequency (%)
748	1	< 0.1%
730	1	< 0.1%
720	1	< 0.1%
703	1	< 0.1%
686	1	< 0.1%
675	1	< 0.1%
673	1	< 0.1%
660	1	< 0.1%
649	1	< 0.1%
647	1	< 0.1%

item_rp_ratio
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
ZEROS

Distinct	1379
Distinct (%)	24.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.01201326554

Minimum	0
Maximum	1
Zeros	4198
Zeros (%)	73.7%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	0.001033139699
95-th percentile	0.04109589041
Maximum	1
Range	1
Interquartile range (IQR)	0.001033139699

Descriptive statistics

Standard deviation	0.06471766549
Coefficient of variation (CV)	5.387183467
Kurtosis	134.7358715
Mean	0.01201326554
Median Absolute Deviation (MAD)	0
Skewness	10.5498386
Sum	68.45158703
Variance	0.004188376226
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4198	73.7%
1	11	0.2%
0.01075268817	4	0.1%
0.009661835749	4	0.1%
0.009259259259	3	0.1%
0.03846153846	3	0.1%
0.0243902439	3	0.1%
0.02380952381	3	0.1%
0.007462686567	3	0.1%
0.01492537313	3	0.1%
Other values (1369)	1463	25.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	4198	73.7%
0.0001169636243	1	< 0.1%
0.0001839926403	1	< 0.1%
0.0002816901408	1	< 0.1%
0.0003140703518	1	< 0.1%
0.0003619254434	1	< 0.1%
0.0003632401017	1	< 0.1%
0.0003637686431	1	< 0.1%
0.0003671071953	1	< 0.1%
0.000393081761	1	< 0.1%

Value	Count	Frequency (%)
1	11	0.2%
0.9863013699	1	< 0.1%
0.8333333333	1	< 0.1%
0.6333333333	1	< 0.1%
0.6115107914	1	< 0.1%
0.6008836524	1	< 0.1%
0.5964566929	1	< 0.1%
0.5648854962	1	< 0.1%
0.5646387833	1	< 0.1%
0.5602040816	1	< 0.1%

net_margin
Real number (ℝ_≥0)

HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION
HIGH CORRELATION

Distinct	1494
Distinct (%)	26.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.9849909884

Minimum	0
Maximum	1
Zeros	11
Zeros (%)	0.2%
Negative	0
Negative (%)	0.0%
Memory size	44.6 KiB

Quantile statistics

Minimum	0
5-th percentile	0.930997443
Q1	0.9979218471
median	1
Q3	1
95-th percentile	1
Maximum	1
Range	1
Interquartile range (IQR)	0.00207815293

Descriptive statistics

Standard deviation	0.06715476332
Coefficient of variation (CV)	0.06817804844
Kurtosis	119.0519217
Mean	0.9849909884
Median Absolute Deviation (MAD)	0
Skewness	-9.742664177
Sum	5612.478652
Variance	0.004509762237
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	3721	65.3%
1	223	3.9%
1	161	2.8%
1	93	1.6%
0	11	0.2%
0.9809727315	1	< 0.1%
0.9791926573	1	< 0.1%
0.9707212523	1	< 0.1%
0.9947665325	1	< 0.1%
0.9631287859	1	< 0.1%
Other values (1484)	1484	26.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	11	0.2%
0.04946653734	1	< 0.1%
0.1336898396	1	< 0.1%
0.1401705408	1	< 0.1%
0.2502340912	1	< 0.1%
0.2829510229	1	< 0.1%
0.324117991	1	< 0.1%
0.3548601864	1	< 0.1%
0.48	1	< 0.1%
0.4870859068	1	< 0.1%

Value	Count	Frequency (%)
1	223	3.9%
1	3721	65.3%
1	161	2.8%
1	93	1.6%
0.9999180769	1	< 0.1%
0.9998431613	1	< 0.1%
0.9997243132	1	< 0.1%
0.9996916904	1	< 0.1%
0.9996728761	1	< 0.1%
0.9996149715	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	var_products	qnt_items	avg_ticket	freq_purchase	qtd_returned	freq_returns	avg_basket_size	avg_basket_variety	item_rp_ratio	net_margin
0	0	17850	5391.21	372.0	34.0	21.0	1733.0	18.152222	17.000000	40.0	1.000000	50.970588	0.617647	0.023081	0.980973
1	1	13047	3232.59	56.0	9.0	105.0	1390.0	18.904035	0.028302	35.0	0.023973	154.444444	11.666667	0.025180	0.955611
2	2	12583	6705.38	2.0	15.0	114.0	5028.0	28.902500	0.040323	50.0	0.105263	335.200000	7.600000	0.009944	0.988660
3	3	13748	948.25	95.0	5.0	24.0	439.0	33.866071	0.017921	0.0	0.000000	87.800000	4.800000	0.000000	1.000000
4	4	15100	876.00	333.0	3.0	1.0	80.0	292.000000	0.073171	22.0	0.078947	26.666667	0.333333	0.275000	0.725000
5	5	15291	4623.30	25.0	14.0	61.0	2102.0	45.326471	0.040115	29.0	0.032468	150.142857	4.357143	0.013796	0.984472
6	6	14688	5630.87	7.0	21.0	148.0	3621.0	17.219786	0.057221	399.0	0.019608	172.428571	7.047619	0.110191	0.907032
7	7	17809	5411.91	16.0	12.0	46.0	2057.0	88.719836	0.033520	41.0	0.013072	171.416667	3.833333	0.019932	0.987609
8	8	15311	60767.90	0.0	91.0	567.0	38194.0	25.543464	0.243316	474.0	0.072193	419.714286	6.230769	0.012410	0.977808
9	9	16098	2005.63	87.0	7.0	34.0	613.0	29.934776	0.024390	0.0	0.000000	87.571429	4.857143	0.000000	1.000000

Last rows

	df_index	customer_id	gross_revenue	recency_days	qnt_purchases	var_products	qnt_items	avg_ticket	freq_purchase	avg_basket_size	avg_basket_variety	net_margin
5688	5779	22700	4839.42	1.0	1.0	55.0	1074.0	78.055161	1.0	1074.0	55.0	1.0
5689	5780	13298	360.00	1.0	1.0	2.0	96.0	180.000000	1.0	96.0	2.0	1.0
5690	5781	14569	227.39	1.0	1.0	10.0	79.0	18.949167	1.0	79.0	10.0	1.0
5691	5782	22704	17.90	1.0	1.0	7.0	14.0	2.557143	1.0	14.0	7.0	1.0
5692	5783	22705	3.35	1.0	1.0	2.0	2.0	1.675000	1.0	2.0	2.0	1.0
5693	5784	22706	5699.00	1.0	1.0	634.0	1747.0	8.988959	1.0	1747.0	634.0	1.0
5694	5785	22707	6756.06	0.0	1.0	730.0	2010.0	9.254877	1.0	2010.0	730.0	1.0
5695	5786	22708	3217.20	0.0	1.0	56.0	654.0	54.528814	1.0	654.0	56.0	1.0
5696	5787	22709	3950.72	0.0	1.0	217.0	731.0	18.206083	1.0	731.0	217.0	1.0
5697	5788	12713	794.55	0.0	1.0	37.0	505.0	21.474324	1.0	505.0	37.0	1.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows